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ABSTBACT 

Presented is an evaluation of a program designed to 
provide individualized instruction for 28 seriously emotionally 
disturbed students in a residential psychiatric program in Nev York 
City. Findings are reported to indicate that the program met its 
objectives in producing significant grovth in both reading and math 
achievement, and additionally produced over 100 X improvement in 
attendance. It is noted that effozrts vere made by the hospital team 
to keep and maintain contact with school programs outside of the 
hospital to vhich the students vould be returning. Listed 
recommendations include that objectives in reading and math be 
defined in terms of the historical regression formulas, that 
instruments used for data collection be improved, and that funding 
for the program be modified. Data forms are appended. (IH) 
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CHAPTER I - Tlffi PROGRAM 

This project was designed to provide individualized instruction 
for two groups of seriously emotionally disturbed students in the 
psychiatric programs at Belle vue Hospital in Manhattan and Kings 
County Hospital in Brooklyn. Originally the program was to provide 
individually prescribed remedial instruction for forty-eight child- 
ren, twenty-eight at Bellevue and twenty at Kings County* Before the 
start of the 197^-75 school year the program was modified to include 
only those twenty-eight children at the Bellevue site. 

The program at Bellevue Hospital serviced forty- two adolescents 
during the school year, a significant increase from the twenty-eight 
children proposed in the planning document. Those children were 
emotionally disturbed adolescents with histories of truancy from 
school, poor academic achievement, and serious adjustment problems. 
Each student in the program was chosen by the hospital team to rep- 
resent a patient who would respond to this highly individualized 
remedial program. 

The Title VI project supported two teachers and two teacher 
aides. This program was focused on severely truant adolescents. It 
was one part of the overall school program at Bellevue Hospital which 
included a much larger ntunber of children than the forty- two served 
in this project. Some of the students were attending other neighbor- 
hood schools for part of the day and spent part of the day at Belle- 
vue in this project. The educational remediation was geared toward 
helping the student meet the demands of a public school placement 
while providing the support of the psychiatric program at Bellevue. 
Students were referred to this project if it was felt that they 
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needed this type of highly individualized program. All students en- 
rolled in the program showed serious academic deficits. The mean age 
in September was Fourteen years - ten months while the mean achieve- 
ment scores in the September pre-testing were 3-8 in Kathf in 
word recognotion, and 5*0 in reading comprehemsion. The students* 
programs were built as a result of the deficits seen in the diagnos- 
tic testing don. on a pre-test basis. 

The program was in operation for the whole 197^-75 school year. 
Fourteen students were pre- tested in September, seventeen in October, 
four in November^ two in J£inuary, two in February, and two in March. 
Two of the , forty-one students had left the program prior to the post- 
testing in May of 1975- All of the students in the program received 
remedial work in reading and mathematics. Contrary to what had oc- 
cured in the past year of the project and what had been predicted in 
the proposal, only a small percentage of the students this year pre- 
sented perceptual disabilities. Consequently, very few of the forty- 
one students in the project were given perceptual training, and very 
few were tested using perceptual tests on a pre and post basis. 

CHAPTER II - EVALUATION PROCEDURES 

The evaluation procedures were designed to measure three areas 
of growth and / or behavior, namely attendance, achievement in read- 
ing and math, and perceptual disabilities. The instruments used were 
standardized ins trximents. Sampling procedures attempted to provide 
data on as many of the forty-one students as possible, on both a pre 
and post test basis. As had been indicated earlier, pre-testing was 
done when the student entered the Bellevue program, and while the 
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majority of pre-teatlng was done in September and Octobery soreral 
students were pre-tested in Noveaibert Jsmuaryv February and March* 
Post Testing was completed in late May of 1975* Two students who 
left the program in March were poet-* tested prior to their discharge 
from' the hospital at BelleTue. 

Specific evaluation data was collected relevant to ^he ..f our 
program objectives, which included the following. 

Program Objective # 1 focused on the efforts of the staff to 
increase attendance over the previous year. The objective of this -i 
aspect of the program was that seventy-five percent of the students 
would show a seventy-five percent increase in attendance # School 
attendance records were made available for the year 1973*7^ » and 
the current 197^75 year. Data on all of the forty-one students was 
available . 

Program Objective # 2 focused on ti>e iiaprovement of reading 
achievement during the school year. Speciflcallyt this objective 
called for at least sixty percent of the students enrolled in the 
program to exhibit a month and a half progress in reading for each 
month that they participated in the projects The highly individual- 
ised nature of the project » hopefully , would help the students sake 
up for the severe deficits in read5jig. Both subtests of recognition 
and coioprehension on the Gilmore Oral Reading Test were given on a 
pre and post basis. Data on pre and post testing was available on 
all forty-one students » although only thirty students were included 
in the analysis. Eight students pre-tested as non-readers and it was 
not considered valid to assign a numerical score to these pre tests* 
Three other students scored off the top of the scale on both the 
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pre and post test and were not included since the test was not 
appropriately nonaed for them. 

Program Objective # 3 foeused on the students with perceptual 
handicaps. Specifically it was the objective of this aspect of the 
program that thirty- five percent of all students who presented per- 
ceptual handicaps would show inqproveaMnt in perceptual skills* The 
instruments used in measuring perceptual handicaps included the 
Illinois Test of Psycholinguistic Abilities, the Wepman Test of 
Auditory Discrimination; and the Detroit Test of Learning Aptitudes. 
Very little data was collected in this area of perceptual handicaps* 
due to the fact that the program for elementary children at Kings 
County was not included in the program and moat of the adolesesnts 
at Bellevue did not present perceptual disabilities. 

Program Objective # 4 focused on £p?6wth in matiiematical achieve- 
ment during the school year. SpecifieallyV the objective was to pro- 
duce growth at the rate of one month for each month a student was 
enrolled in the program. The instrument used to measure this growth 
was the Wide Range Achievement Test. All forty-one of the students 
enrolled in the program were tested on a pre and post basis. 

CHAPTER III - FI NDINGS 

Objective # It As a restilt of participation in the program, 

seventy- five percent of the participants will show a seventy- five 

percent increase in school attendance. 

Table 1 - Attendance Data en Bellevue Population 

Year Mean^Percent Attendance Who. Increased 75 H 

1973-74 36. l^ jg 78.0 ^ 

197^75 Bk.Z % 
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Table 1 indicates that the program more than met this ohjeetive* 
As can be seen, the mean attendance rate for the forty-one students 
diaring the 1973-74' school year was 36.^ ^ of the possible days. 
Dtiring the 197^-75 school year the attendance rate was S^l-.a % of the 
possible days. Seventy-eight percent (32 students out of ^1) did 
increase their rate of attendance at least seventy-five percent over 
the 1973-7^ school year. As a group the shift from 36.^ % attendance 
to 8J^.2 ^ attendance represents an increase of 131 ?5. It should be 
noted that in six !3ases the attendance in the 1973-7^ year was above 
65 f» and the student coiad not possibly have increased his attendance 
by seventy- five percent since it would have reqmired the student to 
attend over 100 ^ of the time. In one sense thirty- two out of a 
possible thirty-five students increased their attendance by seventy- 
five percent over the 1973-7^ school year. 

Objective # 2i As a result of participation in the program, 
sixty percent of the participants will improve by at least 1.5 grade 
units in reading. 

Table 2 - Data on Reading Achievement from the Gilmore Oral 
Reading Test. 

Pre-Test Post-Test > Students Showing 
Sub-Test N» Mean Mean 1.5 Units Growth. 

Word Recognition 30 ^.iK3 5»66 62.1 ^ 

Comprehens ion 30 5.05 6.26 63*3:^ 

* See Chapter II for explanation of discrepancy between 30 and 4-1. 

The data from Table 2 above support the conclusion that the 

program did produce at least 1. 5 units of growth in reading for each 

month of the program for at least 60 ^ of the students. This evidence 

would support the claim that this is an effective program in the 

area of remediation of reading slcills in these students. 
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Objective # 3> As a result of participation in the prograM, 
35 % of those piqplls having perceptual handicaps will show i^provo* 
ment in perceptual areas. 

As was Indicated earlier* the unit in the olcisantary sohool at 
Kic^ County Hospital did not participate in the program as had 
boon originally planned. The unit at Bellevue iXicluCad adeloseonts 
and of the 41 students in that program only five wore givon aay form 
of perceptual testing or training* Because of the above roaaooeui, 
this evaluator did not consider it necessary to carry out a formal 
evaluation of these five students data, since the results vtvlA have 
np &»aning. It should be noted that the five 8ti«dantB did show 
some improvement l^i several of the sub- tests on the I.T.P.A. » t'at 
again It seemed irrelevant to tails about such data when the ob jttct- 
ivos wovo clearly modified when the student population was changed. 

Objective # 'ft As a resxat of participation in the program, 

60 H of the participants will imiprove by at least one school year 

in mathematical abilities. 

Table 3 - Data on Math Aehiovement from the w.R.A.T. 
Mean ^ of Students Showing 1.0 

Time of Test H Score Ifaita of Growth per month. 

Pro-Test kl 3.S« 90.2^ 
Post-Test in 5*23 
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Table 3 indicates a clear success in meeting the objeetlvo of 
producing one month of progress for eaeh month the student was in 
the program in math aehiovement. Seventy- five percent of those In 
the program increased their math scores by at least one year. The 
data also indicated that if the growth is compared with the number 
of months a student was in the program« then 90 % of the stu<lent8 
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made at least one month of progress for each month they were in the 
project. All k-l students in the program were tested on a pre and 
post test basis in math achievement* 

It must be concluded from the review of the above data that the 
program did, indeed, more than meet the objectives which were set 
out in the initial proposal. The results in attendance, reading and 
math achievement are all siipportive of the value of this project. 
These resxats strongly support the impressions this evaluator received 
when participating in the on-site visitations to the program during 
the school year. The project appeared to be a highly structured, 
well coordinated, and effective progrsua in this psychiatric hospitalc 

It was the impression that this program was very relevant and 
meaningful to the needs of the students involved. The materials and 
facilities which were made available to the project were more than 
adequate to the needs of the students, teacherSj sind teacher aides. 
All but three of the students were achieving on a level at least 
two years below the level e:q>ected from their ages, and these three 
students presented severe truancy problems. 

The evaluation report on this project for the 1973-7^ year was 
very positive. Specific recommendations had been made to increase 
the program in size and staff . Additional para-professional staff 
had been recommended. The addition of a highly skilled diagnostic 
evaluation teacher specialist had also been recommended. In addition 
a more multi-modality approach had been recommended. 

The program appears to have responded to those recommendations 
from 1973-7^ wherever possible. The funding of this Title VI project 
had been cut as it went into the second year of t97^75t «nd will 

■ ■ -11,'": :,; 
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be cut again in 1975-76 as the program goes into the third year of 
fxmding. The staff recommended last year have not b^en added due 
to the funding cuts, since the regular school at Bellevue did not 
have the additional money to pay for these additional staff members. 

The recommendations concerning a miilti-modality approach have 
been implemented. Efforts were made to upgrade the diagnostic 
skills of the present teaching staff since it was iiapossible to 
add an additional teacher with highly developed skills in that area. 
In general, the program has tried to respond to the past evaluation 
in an appropriate manner. 

CHAPTER IV - SUMMARY OF MAJOR FINDINGS, CONCLUSIONS AND RECOMMENDATIONS . 

This project of individualized instruction for emotionally 
disturbed children located at Bellevue Hospital , appeared to be a 
highly successful program. The results were very supportive of the 
activities which were included in the project. Students at the 
hospital often present very serious academic handicaps as well as 
a history of school truancy. The individualized instructional program 
as an integrated part of the school for adolescent patients at PS 106 
apparently provides a model of concentrated services which can and 
did produce growth In adolescents. 

The program met its objectives in producing significant growth 
in both reading and math achievement. The program also made a sig- 
nificant impact on the attendance records of the students involved, 
producing over a hundred percent inrprovement in their attendance. 
The only objective which was not met, the remediation of perceptual 
handicaps, was really designed for the elementary school population 



at Kings County Hospital in Brooklyn which was deleted ftom the 
project before September. 

Unique to this program was the efforts of the hospital team to 
keep and maintain contact with school programs outside of the hospital 

. . ■ 

to which the students would be retirming. A large proportion of the 
students spent part of the day or week in the hospital program and 
-part of -the day or week in-a neighborhood -school. Central to the 
program's success was the outreach from Bellevue into the neighbor- 
hood schools. 

Recommendations for improving the program would include the 
followingt 

1. The objectives in reading and math should be defined in 
terms of the historical regression formulas. It was never made 
clear to this evaluator why certain percents were established as 
the criteria for success, and these 60 J{ or 75 ^ success seemed to 
1)0 arbitrary and not really serving any logical purpose. 

2. The instrximents used to carry out the data collection 
could be iarproved, so that they would produce diagnostic infor- 
mation and also give scores for statistical analysis. The Key 
Math test or the math sub- test of the Peabody Individual Achiev- 
ement Test would be more appropriate than the math test on the 
Wide Range Achievement Test. 

3. While the Gilmore Oral Reading Test does give a certain 
amount of information on the reading abilities of the students, it 
would be recommended that either the Woodcoek-Pristoe or the 
reading sub- tests on the Peabody Individual Achievement Test 

be substituted for the Gilmore, and again would serve the dual 
pYirpose of being diagnostic and providing data as well. 
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^. If the program is going to be reinstated in the Kings County 
Hospital with elernentary school aged children* the perceptual 
training aspect of the project should he maintained » but if the 
program will not include an elementary school aged population* the 
objective relating to the growth in perceptual skills should be 
deleted ffom the project. The program at Bellevue has no urgent 
need for w extensive perceptual tralrdng contponent. 

5* A recommendation is being made to try to modify the funding 
of this project. While these students who participated in the 
project this year received essential and relevant services* many of 
them remained on the registers of the neighborhood schools. For 
this reason, Bellevue, PS 106 received no tax levy stq>port for these 
children. This distinction of a child being on one register seemed 
artifical and the funding should have been split, so that Bellevue 
would be able to carry on this program at full strength. 

6. Because of the overwhelming positive data generated from 
this project, and because the several objectives were met, it is the 
strong recozamendation of this evaluator that this project be continued 
and be studied as a model for other schools in the city serving 
an adolescent psychiatric patient population. 
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(attach to KIR, item ^30) Function 09-5660 6« IndlvidtllliMd Instruction 
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In this table enter all Data loss infonnatlon. Between MIR, item #30 and this fom, all participant! 
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(1) Identify the participanta by specific grade level (e.g., grade 3, grade 9). Rhere several grades ire cooblntd, 

enter th6 last two digits of the component code, 

(2) Identify the test used and year of publication (MAT-70, SDAT-74, etc.), 

(3) Number of participants in the activity, 16 

(4) Number of participants included in the pre and posttest calculations found on ltem#30. 

(5) Nuober and percent of participants not tested and/or not analyzed on iteni#30, 

(6) Specify all reasons why students were not tested and/or analyzed. For each reason specified, provide t lepirete 
. : nuaber count. If any further documentation 10 available, please attach to this form. If further ipaci ii 

seeded to specify and expUin data loss, attach additional pagei to this fom. 
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Measures of growth other than Standardized Tests 

30J)» This question is designed to describe the attainment of approved objectives 
not nonaally associated with measurement by norm referenced standardized 
achievement tests. Such objectives usually deal with behavior that Is 
Indirectly observed, especially in the affective domain. For example, a 
reduction in truancy, a positive change in attitude toward learning, a 
reduction in disruptive behavior, an improved attitude toward self (as 
indicated by repeated interviews) ^ etc., are frequently held to be prerequisite 
to the shift toward increased academic achievement by disadvantaged learners. 
Where your approved measurement devices do not lend themselves to reporting on 
tables 30A, B or C, use any combination of items and report on sepnrute pages. 
— Attach additional "pages-lf-necessary^— ..^ — 



Component Code 



Activity Code 



Objective Code 
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* Attendance in Progran. 

Brief Description Attendance In tha school program wag conpared for 
1973" 7^ year and the 197^75 year* Inereaee of 75^ attendance 
1)y 75 % of the stttdents was the objective. 



Number of cases observed 



Number of cases in treatment 
Pretreatment index of behavior (Specify scale used): No scale needed* Re cords 
Of sttident attendance during the 1973-7^ year were examined. T he 
objective of increasing the percentage attended dtaring 1973-7^ 
ealciilated for each child. 
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Criterion of success: 75?^ Of Students (31 Of ^1) miist i ncr ease thei r 
attendance by 75^ ef that prior year of 1973-7^> 

Was objactlve fully met? Yes No If yes, by what criteria do you 

know? 32 of ^1 students increased their attendance by 75?^ over 



the 1973-7* school year(78o0^). 
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Measures of growth other than Standardized Tests 

300. This question Is designed to describe the attaloMnt of Approved objectives 
not normally associated with measurement by norm referenced standardized 
achievement tests. Such objectives usually deal with behavior that is 
Indirectly observed, especially in the affective domain. For example, a 
reduction In truancy, a positive change in attitude toiMrd learning, e 
reduction In disruptive behavior, an improved attitude tovmrd self (es 
Indicated by repeated Interviews), etc., are frequently held to be prerequisite 
to the shift toward increased academic echievement by dlsadventeged leerners. 
Where your approved measurement devices do not lend themselves to reporting on 
tables 30A, B or C, use any combination of itesM and report on separate pages. 
Attach additipnaX, pages If necessary^ ^ 
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Brief Description Pre and Po»t t<»tlng Ming the Word R»oognltlon 
8ub-test of the°^-^^'^>l Reading Ttet, 60 % of partldpante wi ll 
show an inereaae of 1.5 ■onthe for each aonth In the prograa. 



Number of cases observed: 



Numbar of caies In traataenti l | 1^ j ^1 



PretreaCmenC Index of behavior (Specify scale used): 
Gray Oral Reading Toat. ^ 
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criferion of success; 6o % of partloljanta will ahew 1.5 Mentha 
progress for each aonth in the pregra»« 

Was objective fully met? Yes @ No Q If yw. by what criteria do you 
^"""^ 1fl 90 «-HfH>ti-bi •«^) aliaw ■« no ft^ t.K wan-fahft 
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VIII. MACHINE SHOP TRAINING 

1. Bas ic Mechanical Tcgjj^ing . 

Included in this program is training in the use of both hand and power tdols.- 
Basic arithmetic training, as required, may also be provided. Training is included in 
drill press, grinder, bench saw, etc. 

2. Machine Shop Training 



This program includes the elements of the basic training program as well as 
more advanced level training, such as the use of measuring instruments, ability to follow 
sketches and blueprints, and operation of more complex power tools {Shaper, Milling 
Machine, Turret Lathe, etc.) 



IX. INDUSTRIAL TRAINING 

1. Stock-Shipping Room Training 

This program includes training in both the record-keeping and physical duties 
involved in shipping room activities. Included, when required, is arithmetic improvement 
training. 

2. Floor Boy - Floor Girl Training 

Training is provided in floor activities, including supplying of materials, removal 
of completed work, and, where applicable, minor record keeping, and related activities. 

■ 3. Packaging and Assembly 

Training in this area may include not only hand-assembly and inserting, but 
also operation of hand and foot-operated stapling machines, manual and semi-automatic 
heat sealing equipment, etc. For those capable of learning more complex operations, 
training will also be provided in operation of packaging machines, such as blister-pack, 
shrink packaging, and skin pack equipment. 

4. Order Picking 

Training is given in this area in both record-keeping (billing, etc.) and packaging 
duties as relates to employment in eitherjridustrial or retail settings. As indicated, 
experience is also provided in either ticketing and labelling dutjes, or in packing-shipping 
duties, or both. 
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Measures of growth other than Standardized Tests 

This question Is designed to describe the attainment of approved objectives 
not normally associated with measuiament by norm referenced standardized 
achievement tests. Such objectives usually deal with behavior that is 
indirectly observed, especially in the affective domain. For example, a 
reduction in truancy, a positive change in attitude toward learning, a 
reduction in disruptive behavior, an improved attitude toward self (as 
indicated by repeated Interviews), etc., are frequently held to be prerequisite 
to the shift toward Increased academic achievement by disadvantaged learners. 
Where your approved measurement devices do not lend themselves to reporting on 
table8-^30A,-B-or--C ,-uBe-any-^combination ^of^items^and^-report^^.^ 



Attach additional pages if necessary. 

Component Code Activity Code 



Objective Code 
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Brief Description Pre and Pcat testing tcing the Compreh enaion sub- 
test of tho^^^'^^Oral Reading Teat. 60 ^ of the partielpanta wi ll 
ahew an increaae of i»5 aontha for each month In the program* 



Number of cases observed: 
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Number of cases in treatment 
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Pre treatment index of behavior (Specify scale used): 

Qray Oral Reading T>ste - 
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Criterion of success : 60 % of particlpante will a hew 1 . 5 mentha of 
pregreea for each month in the program* — 

Was objective fully «et? Yes g No □ If ye«. by what criteria do you 

know? 19 0f 30 atiidenta (63. 3jS) improved more than 1*5 aontha for 



every month they were in the program. 
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Measures of growth other than Standardized Tests 

This question Is designed to describe the attainment of approved objectives 
not normally associated with measurfsment by norm referenced standardized 
achievemetvC tests. Such objectives usually deal with behavior that is 
indirectly observed, especially in the affective domain. For example, a 
reduction in truancy, a positive change in attitude toward learning, a 
reduction in disruptive behavior, an improved attitude toward self (as 
indicated by repeated interviews), etc., are frequently held to be prerequisite 
to the shift toward increased academic achievement by disadvantaged learners. 
Where your approved measurement devices do not lend themselves to reporting on 
^__tables»-30A,--.B-^or^C,..use^aay_comb±naiJLon_of„^ 



Attach additional pages if necessary. 



Component Code 



Activity Code 



Objective Code 
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Brief Description Pre and Post testing using -the Wide Range Achlev -' 
eaent Test. Math sub- test. 60 ^ of participants will sho w an 
increase of 1.0 months for each month in the program* . 



Number of cases observed: 



Number of cases in treatment: ! j I ll 



Pretreatment index of behavior (Specify scale used): 



1966 edition of the Wide Range Achieyement Test. 
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Criterion of success : 605g of participants will she w 1.0 months . 

progress for each month in the program* 

Was objective fully met? Yes (3 N° CIl " ' what criteria do you 

know? 90.2 ^ of the students (37 of ^1) progressed at least 
1.0 months for each month they were in the program in math. 
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Comments : 
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